Papers with FMM faces limitations stemming
FedLFC: Towards Efficient Federated Multilingual Modeling with LoRA-based Language Family Clustering (2024.findings-naacl)
Copied to clipboard
| Challenge: | Existing frameworks for multilingual modeling face communication costs and parameter interference conflicts. |
| Approach: | They propose a communication-efficient federated learning framework with low-rank adaptation and language family clustering for Multilingual Modeling (MM) they maintain the weights of the base model, updating the lightweight Low-rank adapt parameters to minimize communication costs. |
| Outcome: | The proposed model outperforms the baseline models in performance and reduces communication overhead. |